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Abstract. - We introduce a generalization of the cavity, or Bethe-Peierls, method that allows to 
follow Gibbs states when an external parameter, e.g. the temperature, is adiabatically changed. 
This allows to obtain new quantitative results on the static and dynamic behavior of mean field 
disordered systems such as models of glassy and amorphous materials or random constraint satis- 
faction problems. As a first application, we discuss the residual energy after a very slow annealing, 
the behavior of out-of-equilibrium states, and demonstrate the presence of temperature chaos in 
equilibrium. We also explore the energy landscape, and identify a new transition from an compu- 
tationally easier canyons-dominated region to a harder valleys-dominated one. 
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Mean-field glassy systems are spin (or particle) models 
n fully connected or sparse random lattices that exhibit 
an ideal glass transition. Their studies brought many in- 
teresting results in physics, such as the development of 
mean field theories for structural glass formers, amorphous 
packings and heteropolymer folding [T] , as well as in com- 
puter science, where many results on error correcting codes 
[2 and random constraint satisfaction problems were ob- 
tained and new algorithms developed [2111]. A common 
denominator in all these systems is their complex energy 
landscape whose statistical features are amenable to an 
analytical description via the replica and cavity methods 
[5j|6]. However, many questions about the dynamical be- 
havior in these systems remain largely unsolved, and the 
present Letter addresses some of them via a detailed and 
(Quantitative description of the energy landscape. 

The thermodynamic behavior of mean-field glassy mod- 
els undergoes the following changes when an external pa- 
rameter such as the temperature T is tuned: At high T, 
a paramagnetic/liquid state exists. Below the dynamical 
glass temperature Td, this state shatters into exponentially 
many Gibbs states, all well separated by extensive ener- 
getic or entropic barriers, leading to a breaking of ergod- 
icity and to the divergence of the equilibration time [THS] ■ 
As T is further lowered, the structural entropy density (or 
complexity) may vanish, and the number of states (rele- 
vant for the Boltzmann measure) becomes subexponential 



(and in fact finite [3]). This defines the static Kauzmann 
transition, Tk, arguably similar to the one observed in 
real glass formers [TlllOj. This scenario is called the "one- 
step replica symmetric" (IRSB) picture. In some models 
, the states will divide further into an infinite hierarchy 
of sub-states, a phenomenon called "full replica symmetry 
breaking" (FRSB) [HE]. The IRSB picture is well estab- 
lished in many mean field systems, and the cavity /replica 
method is able to compute the number, the size or the 
energy of the equilibrium Gibbs states. However, with 
the exception of few simple models [71[T^[T3], an analyti- 
cal description of the dynamics and of the way states are 
evolving upon adiabatic changes is missing. In this Letter 
we present an extension of the cavity method that provides 
this description by following adiabatically the evolution of 
a Gibbs state upon external changes. 

Consider for example an annealing experiment where 
temperature T is changed in time as T = To ^ St/N. Take 
the thermodynamic limit N-^oo first and then do a very 
slow annealing (5 — !• 0. This should be able [S] to equili- 
brate down to the dynamical temperature Td after which 
the system get stuck in one of the many equilibrium Gibbs 
states. Computing the energy of the lowest configuration 
belonging to this state would give the limiting energy for 
a very slow annealing. However, while the standard cav- 
ity and the replica method predict all the properties of an 
equilibrium state at a given temperature Tp, they do not 
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Fig. 1: (color online) A cartoon of the energy landscape in 
mean field glassy systems. The different valleys correspond to 
different Gibbs states and are separated by extensive barriers. 
The cavity or replica method can compute how many states of a 
given entropy are present at a given energy /temperature). The 
following states method instead pins up one state (in green) 
that is one of the equilibrium ones at energy Cp (or temper- 
ature Tp) and computes its properties (entropy, energy) for 
another temperatures T. At T = 0, it leads the properties of 
the bottom of the state as e.g. the limiting energy ebottom- 



tell how these properties change for this precise state when 
the temperature changes adiabatically to T ^ Tp 0. This 
is precisly the type of question that our method adresses 
(for an intuitive description of our goals, see Fig. [T]). 

Following Gibbs states. — How to follow adiabati- 
cally a given Gibbs state? Consider first the two "up" and 
"down" equilibrium states in an Ising ferromagnet at low 
temperature. We can force the system to be in the Gibbs 
state of choice by fixing the all negative or all positive 
boundary conditions. Even far away from the boundaries, 
the system will stay in the selected state for all T < Tc 
(above the Curie point Tc any boundary condition will re- 
sult in a trivial paramagnetic state). By solving the ther- 
modynamics conditioned to the boundaries, we can thus 
obtain the adiabatic evolution of each of the two states. 

What boundary conditions should be applied in glassy 
systems where the structure of Gibbs states is very compli- 
cated? The answer is provided by the following gedanken 
experiment |14) : Consider an equilibrium configuration of 
the system at temperature Tp. Now freeze the whole sys- 
tem except a large hole in it. This hole is now a sub-system 
with a boundary condition typical for temperature Tp. If 
the system is in a well-defined state, then no matter the 
size of the hole, it will always remain correlated to the 
boundaries and stay in the same state. One may now 
change the temperature and study the adiabatic evolution 
of this state. This can be achieved through Monte-Carlo 
simulations in any model. We shall here instead concen- 
trate on mean-field systems, where this construction al- 
lows for an analytic treatment in the spirit of the cavity 
method il5ul6i. 



Mean field glassy models. — We focus on two of the 
most studied mean field glassy systems: the Ising p-spin 
[T7] and the Potts glass [TH] models. These are also of fun- 
damental importance in computer science where they are 
known as the XOR-SAT [12] and coloring problems. 
Consider a graph defined by its vertices i = {1, . . . , N} 
and edges (i, j) G £, the coloring Hamiltonian reads 



(1) 



where s = 1, . . . , g are the values of the Potts spins. The 
Ising p-spin is defined on a hyper-graph with N vertices 
and M p-body interactions (or constraints, if only zero 
energy configurations are of interest) with the Hamiltonian 
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Hi{s}) 



(2) 



a=l 



^By "adiabatic" we mean linearly slow in the system size: of 
course, exponentially slow annealings always find the ground state. 



where s = ±1, 9a is the set spins involved in interaction 
a, and = ±1 are chosen uniformly at random. For 
XOR-SAT; one defines instead the number of unsatisfied 
constraints E^oi- = {M + Ep_spin)/'2, hence for XOR-SAT 
also the temperature is divided by a factor 2 with respect 
to the p-spin model. With these definitions, the XOR-SAT 
and coloring problems are said to be satisfied if the ground 
state energy is zero. In both cases, we will consider the 
lattice to be a random (hyper-)graph with fixed degree c, 
i.e. every variable being involved in c interactions, in the 
thermodynamic limit, N ^ oo. Wc also consider the large 
connectivity c — >■ NP~^/{p— 1)! limit of (g]) with Ja = 
±V^/(V27VP-i): the "fully-connected" p-spin model il7j . 

Cavity equations for following states. We now 

derive the state-following equations for Tp > Tk in the 
XOR-SAT problem. This derivation can be generalized for 
Tp < Tk , and for any model where the cavity approach [5] 
can be applied, and this shall be detailed elsewhere pT] . 

As a large random (hyper-)graph is locally tree-like, let 
us thus first consider the problem on a large (hyper-)tree 
(see Fig. [2]). Once the proper boundary conditions are cho- 
sen, computations on the tree give correct results for large 
random graphs: this is the basis of the cavity approach. 

We derive the method of following states for the p-spin 
Hamiltonian ([2]). We concentrate on an equilibrium state 
at Tp, with Tp > Tk, where the equilibrium solution is 
given by the replica symmetric (RS) cavity method, or 
equivalently by the fixed point of the Bethe-Peierls (or 
Belief Propagation, BP) recursion [TO]: 

/3/i'^" = E atanh[tanh(/3J6) J| tanh (/J/i^"*'')] = 

bedi\a j<£db\i 

^(3T{{h^^'},P), (3) 

where is an effective cavity field seen by the spin i 

due to all its neighboring spins j except those connected 
to the interaction a; hy di\a we denote all interaction in 
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Fig. 2: (color online) a) Recursive construction of an equilib- 
rium configuration at temperature Tp in XOR-SAT. Given the 
tree, and a random choice of interactions (full square J = 1, 
empty square J = —1), one starts from the root, and chooses 
iteratively the configuration of ancestors (full circles s — 1, 
empty circle s = —1) randomly such that it satisfies the 
constraints with probability 1 — e{Tp) (here e — 3/7). Vio- 
lated constraints have dashed/red borders, b) The problem 
can also be Gauge transformed into a fully polarized config- 
uration with all s = 1 but where the J's are chosen from 
Pp(J) = e{Tp)5{J + 1) + [1 - e{Tp)]5{J - 1). 



which spin i is involved except a. For Tp >Tk the effective 
field /i*^" = for all edges ia, and the fraction of violated 
constraints is hence e(Tp) = (1 + e^/^")"^ [l9| . 

One can generate an equilibrium configuration on a tree 
once the effective fields are known |15j using the iterative 
procedure described in Fig. [5] The values assigned to the 
variables on the leaves are then fixed and the measure 
they induce in the bulk of the tree defines an equilibrium 
Gibbs state at temperature Tp. As long as Tp > Tk, the 
computation in the bulk of the tree describes correctly the 
properties of the problem on the random graph. 

All the properties of the Gibbs state are thus obtained 
by solving the BP equations initialized in this boundary 
configuration. When T = Tp > Tk, the results of the 
usual IRSB calculation are recovered, as first discussed in 
the context of reconstruction on trees [T3] . For T = Tp > 
Td BP will converge back to /i'^" = for all edges ia, but 
when Td > T = Tp > Tk , the configuration we picked lies 
in one of the exponentially many equilibrium Gibbs states 
and the BP fixed point thus describes one of them. 

Now is the new crucial turn: Since the boundary condi- 
tions define the equilibrium Gibbs state at Tp, we can use 
the BP equations ^ initialized in the boundary condition 
but with a different temperature /3 = 1/T ^ ^/Tp. The 
resulting fixed point now describes the properties of the 
very same state but at a different temperature T ^ Tp. 

This line of reasoning translates readily in a set of 
coupled recursive cavity equations, which are a two- 
temperatures extension of the reconstruction formalism 
[THKin]. Two distributions of fields Ps{h), with s = ±1 
depending on whether the site was set ±1 in the broad- 



casting, are given by 

P.(/i)=5^P(J,) 



^ 2P-1 cosh/3„ 

^ A 1 A 1 



. p-1 c-1 



(4) 

where the delta function ensures that cavity field h is re- 
lated to the fields h?^ via eq. ([3]). The term in front of the 
integral describes the properties of the equilibrium config- 
uration at inverse temperature /3p. Eq. Q describes adia- 
batic evolution of a Gibbs state that is one of the equilib- 
rium ones at /3p < /3x in the p-spin model with distribution 
of interaction strength P(Jq) = p(5( J— 1) -|~ (1 — J-|- 1), 
it can be solved numerically using the population dynam- 
ics technique [S]- The (Bethe) free energy of the same 
state at the new temperature T reads 



c . ^ A — 1 ^ T 



^ 2P cosh /3p 



where the Z's are 

a+da _ COSh(/3Ja)n,saa2cOsh(^fe' 



Z' 



1 



-[1 + tanh i/Su")] , 



Z' = 2cosh(/3^u''^') Yl 



bedi 



bedi 



2 cosh pu' 



(6) 



where tanh {^u''^') = tanh (/?Jfc) Ujedb\i tanh {j3h^^''). 

Gauge transformation. — fn the p-spin model, the 
above equations can be further simplified by exploiting a 
Gauge invariance. For any spin j, the Gauge transforma- 
tion Si — >■ —Si and Jij — > —Jij for all j G di keeps the 
Hamiltonian eq. ([2]) invariant. As shown in Fig.[2l this al- 
lows to transform the equilibrium spin configuration into 
a uniform one (all s = 1), the disorder distribution then 
changes to Pp{J) (see Fig. [5]). Since all s = 1, there is 
no need to distinguish between the -1-1 and the —1 sites, 
and eq. (|4]) reduces to the usual replica symmetric cav- 
ity equation for a problem with mixed ferromagnetic/anti- 
ferromagnetic interactions at temperature T initialized in 
the uniformly positive state, where the distribution of in- 
teractions is given by the Nishimori-like [22] condition 
P( J) = e{Tp)S{J + 1)"+ [1 - e{Tp)]S{J - 1). 

The Gauge invariance have thus transformed the task 
of following an equilibrium state in a glassy model into 
simply solving a known ferromagnetically biased model 
with the standard cavity approach. One can show in par- 
ticular that following states in the fully connected p-spin 
model for Tp > Tr- is equivalent to solving the p-spin 
model with an additional effective ferromagnetic coupling 
{Ja)NP"^/p\ ~ Jq** = /3p/2, and one can thus readily take 
the solution of the p-spin in the literature, e.g. [T7], to 
obtain properties of equilibrium states. 
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Fig. 3: (color online) Behavior of Gibbs states in mean field glassy systems: the energy e is plotted as a function of temperature T. 
The equilibrium energy (blue) is shown, together with the energy of several states (red) bellow the dynamical transition where 
we follow them out-of-equilibrium. States can be followed a) upon heating until a spinodal point (black-dotted curve) and b) 
upon cooling until they reach their bottom at zero temperature. However, the states closer to Td undergo a FRSB transition 
upon cooling and divide into many marginally stable sub-states at a temperature T™, < Tp (red-dotted curve). Left: the 
fully-connected 3-spin model with its dynamical Td, Kauzmann Tk and Gardner To (equilibrium states becoming FRSB 
transitions. We have used the IRSB formalism to follow all the states down to zero temperature. The uppermost point at T = 
thus gives a IRSB lower bound on the limiting energy of an adiabatically slow simulated annealing. Inset: the behavior of states 
for Tp < Tk, explicitly demonstrating the presence of temperature chaos. Middle: the XOR-SAT problem for p = 3, c = 3 
where Tk ~ 0. Again, the higher energy states become unstable, here we used only the RS formalism and thus were not able 
to continue all of them to zero temperature. In this model all Tp > states finish at a finite bottom energy at T = 0. Right: 
The 4-coloring of graphs with degree c = 9. The situation is similar to the XORSAT case except that here all the states have 
their energy decaying very fast to zero when T — >■ 0. Asterixes (green) represent the results of adiabatic simulations starting 
from an equilibrated configuration on a = 10'' graph using Monte-Carlo (in XORSAT) and BP (in coloring) evolution. 



Energy landscape. — We now present the results of 
the above formalism for the fully connected 3-spin prob- 
lem, the XOR-SAT with c = 3,p = 3 and the 4-coloring 
of graphs with degree c — 9. Fig. |3] shows the energy 
density e(T) for several Gibbs states, that are the equilib- 
rium ones at T = Tp, as they become out-of-equilibrium 
at T Tp. Although such plots were often presented as 
sketches in previous works, analytical results were so far 
available only for few very simple models [71ll2j. 

We confirmed that glassy equilibrium Gibbs states ex- 
ist only for Tp < Td while for Tp > Td we saw only the 
liquid solution. As these states are heated, they can be 
followed until a well-defined spinodal temperature T^iTp) 
that grows as Tp decreases (this is reminiscent of the Ko- 
vacs effect in glassy materials [13]). Interestingly we find 
that Ts{Tp = Td) ~ Td, i.e. an equilibrium state at Td 
disappears (melts) for any increase of temperature, this 
is at variance with the (unphysical) behavior in spherical 
models where such a state exists until much larger T [12] . 

We also consider the state evolution upon cooling. As 
anticipated based on the statistical features of the energy 
landscape [H] and the study of spherical models [71 [T^. 
we find that for Tp near enough the dynamical tempera- 
ture Td, the states undergo a FRSB transition: at some 
T,„ < Tp the states decompose into many marginally sta- 



ble sub-states [TT]. In such a case the exact solution for 
adiabatic evolution requires the FRSB approach [5] and 
our RS approach yields only a lower bound on the true en- 
ergy. Moreover, for temperatures slightly below the FRSB 
instability, the RS solution undergoes an unphysical spin- 
odal transition and wc arc thus unable to obtain even the 
RS lower bound. For the fully connected p-spin model we 
have therefore used the IRSB formalism (using the map- 
ping onto the ferromagnetic-biased model) which allowed 
us to follow states until T = (see Fig. [31 right panel). 
The FRSB solution is numerically much more involved, 
making the exact analysis obviously more difficult. 

Note that following the evolution of a state that is the 
equilibrium one at Tp = Td is particularly interesting. An 
adiabatically slow annealing is able to equilibrate down to 
Td and the evolution of the state at Td is thus giving the 
asymptotic behavior of the simulated annealing algorithm. 

To assess the validity of our approach, we have per- 
formed numerical simulations. For models such as XOR- 
SAT and coloring for T > Tk, where the annealed average 
is equal to the quenched average, it is possible to use the 
quiet planting trick [TS| to generate an equilibrated con- 
figuration together with a typical random graph: Start- 
ing with a random configuration one simply creates the 
(hyper-)graph randomly such that the configuration has 
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e{Tp)N violated constraints. As seen in Fig. [31 when ini- 
tialized in Tp e [Td,TK], the evolution upon heating and 
cooling, simulated both by BP and slow Monte-Carlo sim- 
ulations, follows precisely our predictions. 

Finally, we have also consider the adiabatic following 
of states for Tp < Tk- Their behavior is depicted in the 
inset of the left panel in Fig. [31 At variance with the situ- 
ation in spherical models [H] , these states become out-of- 
equilibrium as soon as the temperature is changed. The 
equilibrium configurations for T < Tk thus do not belong 
to a single state, but instead to a succession of many dif- 
ferent states whose free energies cross as T changes: This 
demonstrates explicitly the presence of temperature chaos 
in the static glass phase T < Tk [T5] . 

Comparison with previous approaches. How 

do our results compare with previous heuristic approaches 
to adiabatic annealings? Two arguments have been mainly 
proposed. The first one is the marginality criterion [5| ac- 
cording to which the energy reached by a slow annealing 
at zero temperature can be computed by sampling a typi- 
cal energy minima at a given energy e, and then choosing 
e such that this minima is marginally stable with respect 
to the replica symmetry breaking. This uniform minima- 
sampling argument is, however, unjustified, since the dy- 
namics always goes in out-of-equilibrium states bellow T^. 
Indeed, as already shown by [24] . the marginality criterion 
is not correct and its result not consistent. 

A refined approach called iso-complexity was thus in- 
troduced in [23]. It is proposed to count the number of 
equilibrium states at a given Tp, and then to consider the 
energies at T < Tp for which the number of states is equal 
to the one at Tp. Iso-complexity leads indeed to a lower 
bound on adiabatic annealings, because in order to end up 
at lower energies one would have to be exponentially lucky. 
With our formalism (where we explicitly follow states) we 
checked that adiabatic annealings always ends up at higher 
energies than the iso-complexity ones. This is illustrated 
in Fig. m where we show the energy of the bottoms of 
states that are the equilibrium ones at temperature Tp and 
compare it to the iso-complexity result (that gives strictly 
lower values). Unfortunately the RSB instability within 
states mentioned previously prevents us from estimating 
the asymptotic energy when Tp is close to T^. 

Canyons versus valleys. — An important class of 
mean field glassy models are the constraint satisfaction 
problems where one searches for a configuration satisfying 
all the constraints. As opposed to early predictions |2, it 
has been observed that glassiness does not prevent sim- 
ple algorithms from finding a ground state [501 Hi]. The 
following state method allows to understand this fact and 
to shed light on the energy landscape of these problems. 
Indeed, we see in Fig. [3] that although in the XOR-SAT 
problem all the typical finite Tp equilibrium states have 
their bottoms at positive energies, the situation is different 
in 4-coloring with c = 9 where all depicted states descent 
to zero energy when the temperature is lowered. 
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Fig. 4: (color online) Comparison between the exact adiabatic 
evolution of states and the iso-complexity lower bound. The 
black line is the energy of the bottoms of states that were the 
equilibrium ones at temperature Tp £ [Tk , Td] in XOR-SAT 
for c — 3, p = 3 (left, the inset is a zoom) and for c — 4, p — 3 
(right). The red (upper-most) line is the equilibrium energy at 
Tp. The blue line is the iso-complexity lower bound [55|. 



Looking back to Fig. [T] we see that the landscape has 
many valleys with bottoms at finite energies, but also 
canyon-shaped states that reach the ground state energy. 
We now define two types of glassy landscape: (1) In 
the canyons-dominated landscape, a typical (equilibrium) 
state at Tp = Td has its bottom at zero energy while (2) 
in the valleys-dominated landscape a typical equilibrium 
state at Td has its bottom at strictly positive energy. 

In order to quantitatively observe canyons and valleys, 
we have computed the "shape" of the states (see Fig. [S]). 
For XOR-SAT at c = 3, p = 3 we observe the standard 
picture of valleys with bottoms at positive energy. In 4- 
coloring of graph with degree c = 9, however, the states 
indeed have a canyon-like shape and go down to zero en- 
ergy. While an adiabatic annealing would be stuck at finite 
energy in the first case, it would instead reach a solution 
(although not an equilibrium one) in the second one. This 
is not to say that 4-coloring of graphs of degree c = 9 
is really easy (since we are speaking of an infinitely slow 
annealing procedure) but rather to explain based on an- 
alytical calculations why it is sometimes possible to find 
solutions even in the clustered glassy phase using simple 
local search algorithms, as observed in [201125] . 

In problems such as graph coloring or satisfiability of 
Boolean formulas, there will thus be a sharp transition (in 
general different from the clustering and the satisfiability 
transitions) as the constraint density is increased, where 
the energy landscape changes from canyon-dominated to 
valley-dominated one: this transition marks the onset of 
difficulty of the problem for an ideally slow annealing, 
and most likely also for other stochastic local search al- 
gorithms. This point can be in principle computed by the 
following state formalism, however, the replica-symmetry- 
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Entropy s Entropy s 

Fig. 5: (color online) Data from Fig. [3] plotted in order to vi- 
sualize the energy landscape. The energy e is plotted against 
the entropy s = /3(e — /) for different equilibrium states. We 
plotted s(e)/2 and — s(e)/2 such that the width corresponds to 
the logarithm of the number of configurations at energy e for 
the Gibbs state. Left: XOR-SAT with c = 3, p = 3. Right: 
4-coloring of random graphs with c = 9. The black curve corre- 
sponds to the equilibrium total entropy. The red curves are dif- 
ferent equilibrium states, corresponding to Tp = 0.15, 0.2, 0.24 
(left), and Tp = 0.12 on (right), the energies corresponding to 
Tp are depicted by horizontal black dashed lines. The left side 
states, with their finite energy bottoms, remind us of the valley 
in Fig. [TJ while the right side reminds of deep canyons that all 
reach the ground state energy. 

breaking instability discussed above complicates the nu- 
merical resolution of the corresponding equations and we 
will thus discuss it elsewhere [H]. We also show ex- 
plicitely in |21| that this transition is upper bounded by 
the so-called rigidity transition point where frozen vari- 
ables appear in the equilibrium ground state configura- 
tions pUll^ . This further supports the conjecture of [20] 
that solutions with frozen variables are really hard to find. 

Another observation can be made from Fig. [3j Even 
if one equilibrates the system at T = T^, the state soon 
becomes unstable towards FRSB upon cooling. There- 
fore any cooling procedure will end up at best in far from 
equilibrium FRSB states. This shows how futile are the 
attempts to study equilibrium predictions, such as the ap- 
pearance of clustering or BP fixed points, starting from 
solutions obtained by heuristics solvers that performing a 
kind of annealing in the landscape. Instead typical config- 
uration must be obtained. This can be achieve by Monte- 
Carlo, or using exhaustive search \27\ for small instances, 
or by planting [16] for larger ones (as we did in FiglSl) 

Conclusions. — We have described how to follow adi- 
abatically Gibbs states in glassy mean field models, and 
answered some long-standing questions on their energy 
landscape: We have discussed the residual energy after 
an adiabatically slow annealing, the behavior of out-of- 
equilibrium states, and demonstrated the presence of tem- 
perature chaos. We have also found new features of the en- 
ergy landscape, and identified a transition from a canyons- 
dominated landscape to a valleys-dominated one. 



The following state method presented here has a wide 
range of applications and we believe that many mean fields 
model will profit from being revisited in these directions. 
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